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Organization 


= Core Feature Teams = 
= Program Managers 
= Developers 
= Testers 

= Central Services 


= Release 
Management 
= Build/UA/LOC 


= Product Marketing 


Technology Areas 


Base OS 
Networking 

Server 

Client 

Management 
COM+/Web services 
Other 


Roles played by the core teams 
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Roles played by the core teams 


Daily Lifecycle Video 


Test Cycles 
= Daily 

= War Room meeting 

= Key Indicators tracked 
m Weekly 

= IDW 

= IDS 

= Automation Test Pass 
= RC/Beta 

= System Level Tests 

= Customer Feedback Review 

= Formal Signoff 


User Base Quality 


RC/Beta Builds 


Weekly Builds 


Daily Builds 


Ship Criteria 


Internal Test 


Signoff 
Process 


Partners 


PSS 
& 
Customers 


Test Team's Role 


= Customer Advocate 


ISV : API / Interface level (SDK) 
IHV/OEM : WHQL Logo Test Kits (DDK) 
Admin, End User Experience 


= Component level 
= System level 


Compatibility, Reliability, Security 


= Globalization, Localization, Accessibility 


Setup, Configuration,Upgrade matrix 
Manageability, Performance, Scalability 
Deployment, Integration, Interoperation 


Focus on Compatibility 


= Hardware Compatibility 
= 10,000 devices supported 
= 5000 OEM systems supported 
= 100+ hardware vendors shipping systems 
with Win2000 at launch 
= Software Compatibility 
= 7000+ applications supported 


= Internal test focused on productivity and 
server applications 


= Worked with customers and partners to 
test line-of-business applications 


Focus On Reliability 


Load profile of key services 
Simulation of peak loads 

= Recovery from fault injections 

MTTB, MTTR, Availability 

Driver Verifier, Prefix, leak monitoring 
Internal, ITG and Customer data 

= >5000 customer site servers tracked 

= Good correlation with internal data 


Focus on Deployments 


Staged deployment plans for key 
services 


End to End scenarios deployed 


Windows2000 team self hosted for 2+ 
years 


JDP program : Live Deployments 


Microsoft deployed 70,000 desktops 
and 2000+ servers before launch 


Several DotComs went live 
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